Applying Model-based Distributed Continuous Quality Assurance Processes to Enhance Persistent Software Attributes
نویسندگان
چکیده
Time and resource constraints often force developers of highly configurable quality of service (QoS)-intensive software systems to guarantee their system’s persistent software attributes (PSAs) (e.g., functional correctness, portability, efficiency, and QoS) on very few platform configurations and to extrapolate from these configurations to the entire configuration space, which allows many sources of degradation to escape detection until systems are fielded. This article illustrates how distributed continuous quality assurance (DCQA) processes help improve the assessment of these PSAs across large QoSintensive software system configuration spaces. We also illustrate how model-based DCQA processes enable developers to run formally-designed screening experiments that isolate the most significant configuration options, such as different workload parameters, operating system, compiler flags, feature sets, and/or run-time optimization controls. Our empirical results show that DCQA processes can be used monitor, safeguard, and enforce PSAs at an acceptable level of cost and
منابع مشابه
Validating Quality of Service for Reusable Software Via Model-Integrated Distributed Continuous Quality Assurance
Quality assurance (QA) tasks, such as testing, profiling, and performance evaluation, have historically been done in-house on developer-generated workloads and regression suites. Performance-intensive systems software, such as that found in the scientific computing grid and distributed real-time and embedded (DRE) domains, increasingly run on heterogeneous combinations of OS, compiler, and hard...
متن کاملA Model-based Distributed Continuous Quality Assurance Process to Enhance the Quality of Service of Evolving Performance-intensive Software Systems
Time and resource constraints often force developers of highly configurable systems, such as that found in performance-intensive software, to assess their system’s performance on very few configurations and to extrapolate from these to the entire configuration space, which allows many performance bottlenecks and sources of QoS degradation to escape detection until systems are fielded. To improv...
متن کاملDistributed Continuous Quality Assurance Leveraging User Resources to Improve Software Quality Around-the-World, Around-the-Clock
Quality assurance (QA) tasks, such as testing, profiling, and performance evaluation, have historically been done in-house on developergenerated workloads and regression suites. Since this approach is inadequate for many systems, tools and processes are being developed to improve software quality by increasing user participation in the QA process. A limitation of these approaches is that they f...
متن کاملDistributed Continuous Quality Assurance Process for Evaluating QoS of Performance-Intensive Software
Performance-intensive software is increasingly being used on heterogeneous combinations of OS, compiler, and hardware platforms. Examples include reusable middleware that forms the basis for scientific computing grids and distributed real-time and embedded systems. Since this software has stringent quality of service (QoS) requirements, it often provides a multitude of configuration options tha...
متن کاملDistributed Continuous Quality Assurance: The Skoll Project
Quality assurance (QA) tasks, such as testing, profiling, and performance evaluation, have historically been done in-house on developergenerated workloads and regression suites. Since this approach is inadequate for many systems, tools and processes are being developed to improve software quality by increasing user participation in the QA process. A limitation of these approaches is that they f...
متن کامل